Evaluating Density Forecasting Models
نویسندگان
چکیده
Density forecasting in regression is gaining popularity as real world applications demand an estimate of the level of uncertainty in predictions. In this paper we describe the two goals of density forecasting sharpness and calibration. We review the evaluation methods available to a density forecaster to assess each of these goals and we introduce a new evaluation method that allows modelers to compare and evaluate their models across both of these goals simultaneously and identify the optimal model.
منابع مشابه
Comparing the Accuracy of Density Forecasts from Competing Models
A rapidly growing literature emphasizes the importance of evaluating the forecast accuracy of empirical models on the basis of density (as opposed to point) forecasting performance. We propose a test statistic for the null hypothesis that two competing models have equal density forecast accuracy. Monte Carlo simulations suggest that the test, which has a known limiting distribution, displays sa...
متن کاملEvaluating the Performance of Forecasting Models for Portfolio Allocation Purposes with Generalized GRACH Method
Portfolio theory assumes that investors accept risk. This means thatin the equal rate of return on the two assets, the assets were chosenthat have a lower risk level. Modern portfolio theory is accepted byinvestors who believe that they are not cope with the market. Sothey keep many different types of securities in order to access theoptimum efficiency rate that is close to the rate of return o...
متن کاملOut-of-Sample Forecast Tests Robust to the Window Size Choice
This paper proposes new methodologies for evaluating out-of-sample forecasting performance that are robust to the choice of the estimation window size. The methodologies involve evaluating the predictive ability of forecasting models over a wide range of window sizes. We show that the tests proposed in the literature may lack power to detect predictive ability, and might be subject to data snoo...
متن کاملCreep Life Forecasting of Weldment
One of the yet unresolved engineering problems is forecasting the creep lives of weldment in a pragmatic way with sufficient accuracy. There are number of obstacles to circumvent including: complex material behavior, lack of accurate knowledge about the creep material behavior specially about the heat affected zones (HAZ),accurate and multi-axial creep damage models, etc. In general, creep life...
متن کاملWorking Paper No. 11-31 Out-of-sample Forecast Tests Robust to the Choice of Window Size
This paper proposes new methodologies for evaluating out-of-sample forecasting performance that are robust to the choice of the estimation window size. The methodologies involve evaluating the predictive ability of forecasting models over a wide range of window sizes. We show that the tests proposed in the literature may lack the power to detect predictive ability and might be subject to data s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006